ChatGPT

presented by
Health Tech
AI healthcare

In This Round, Humans 1, AI LLMs 0

Anthropic's Claude3-Opus performed better than GPT-4, but both fell short of humans on a test of objective medical knowledge. The study was conducted by a firm developing LLMs specifically for healthcare that claim to be incorporating peer-reviewed sources of information.

Hospitals, Health Tech, Artificial Intelligence, Providers

Research Shows Generative AI In The EHR Can Work Well, But Only With Human Oversight

Mass General Brigham researchers conducted a study to learn more about the efficacy of large language models when used to draft responses to patient messages in the EHR. The results showed that these AI tools can do a good job at reducing physicians’ workloads and improving patient education — but also that these tools have limitations that require human oversight.

Health Tech

Advice Given by ChatGPT Vs. Human Providers Is Nearly Indistinguishable, NYU Study Says

NYU researchers conducted a study this year in which nearly 400 people were asked to identify whether responses to patient questions were produced by human providers or ChatGPT. Participants had a limited ability to tell the source of the responses apart, so the study authors concluded that the use of LLMs like ChatGPT could be an effective way to streamline healthcare providers’ communication with patients.

presented by
Health Tech

UNC Health Pilots In-House Generative AI App to Alleviate Burnout

UNC Health recently launched a pilot for its in-house generative AI app called Ava, which stands for “AI virtual assistant.” The app allows staff members to ask questions about the different digital health tools available to them across the health system, and it gives them concise answers about how to use the tools effectively. The goal is to prevent staff from searching through vast training libraries.